Web Survey Bibliography
Title Psychological research in the internet age: The quality of web-based data
Source Computers in Human Behaviour, 58, pp. 354-360
Year 2016
Access date 15.02.2016
Abstract The internet is increasingly used in psychological research to solicit participants and collect data. This paper includes two studies examining the quality of data obtained via web-based methods administered either inside or outside the lab. Both studies used item recognition accuracy as a proxy for attention to questions. Study 1 examined the extent to which undergraduate participants (N = 504) read and attended to questions either inside or outside the lab. Study 2 (N = 744) replicated Study 1, added a Mechanical Turk sample, and examined attention to non-intuitive survey instructions. Results indicated that participants demonstrated good item recognition, regardless of locale or sample; however, small sex effects on accuracy were found in both studies. Specifically, women were more accurate at identifying previously seen items than men in both Study 1 and Study 2. In Study 2, Mechanical Turk participants were more likely to read instructions than undergraduate participants, regardless of whether they participated inside or outside of the lab. The findings support the use of the internet for sampling purposes as well as survey administration, and suggest that researchers use care when studies include non-intuitive instructions.
Access/Direct link ScienceDirect (Abstract) / (Full text)
Year of publication2016
Bibliographic typeJournal article
Web survey bibliography - Computers in Human Behaviour (42)
- Careless Response and Attrition as Sources of Bias in Online Survey Assessments of Personality Traits...; 2017; Meade, A. W.; Ward, M. K.; Alfred, C. M.; Pappalardo, G.; Stoughton, J. W.
- Web survey experiments on matrix questions; 2017; Liu, M.
- Facebook, Twitter, & Qr codes: An exploratory trial examining the feasibility of social media mechanisms...; 2016; Gu, L. L.; Skierkowski, D.; Florin, P.; Friend, K.; Ye, Y.
- On-line life history calendar and sensitive topics: A pilot study; 2016; Morselli, D.; Berchtold, A.; Granell, J.-C. S.; Berchtold, And.
- The impact of visual design and response formats on data quality in a web survey of MOOC students; 2016; Maloshonok, N.; Terentev, E.
- Development of a scale to measure skepticism toward electronic word-of-mouth; 2016; Zhang, Xia.; Ko, M.; Carpenter, D.
- Improving social media measurement in surveys: Avoiding acquiescence bias in Facebook research; 2016; Kuru, O.; Pasek, J.
- Psychological research in the internet age: The quality of web-based data; 2016; Ramsey, S. R.; Thompson, K. L.; McKenzie, M.; Rosenbaum, A.
- Internet Abusive Use Questionnaire: Psychometric properties; 2016; Calvo-Frances, F.
- Equivalence of paper-and-pencil and computerized self-report surveys in older adults; 2016; Weigold, A.; Weigold, I. K.; Drakeford, M. K.; Dykema, S. A.; Smith, C. A.
- Investigating respondent multitasking in web surveys using paradata; 2016; Sendelbah, A.; Vehovar, V.; Slavec, A.; Petrovcic, A.
- The effect of email invitation elements on response rate in a web survey within an online community; 2016; Petrovcic, A.; Petric, G.; Lozar Manfreda, K.
- A reliability analysis of Mechanical Turk data; 2016; Rouse, S. V.
- Validation of the new scale for measuring behaviors of Facebook users: Psycho-Social Aspects of Facebook...; 2015; Bodroza, B.; Jovanovic, T.
- An experiment testing six formats of 101-point rating scales; 2015; Liu, M.; Conrad, F. G.
- Doing online research involving university students with disabilities: Methodological issues; 2015; De Cesarei, A.; Baldaro, B.
- Data collection mode effect on feeling thermometer questions: A comparison of face-to-face and Web surveys...; 2015; Liu, M., Wang, Yi.
- Using virtual presence and survey instructions to minimize careless responding on Internet-based surveys...; 2015; Ward, M. K.; Pond III, S. B.
- The comparison of mobile devices to computers for web-based assessments; 2015; Huff, K. C.
- Differences in intrapersonal and interactional empowerment between lurkers and posters in health-related...; 2014; Petrovcic, A., Petric, G.
- Social desirability is the same in offline, online, and paper surveys: A meta-analysis; 2014; Dodou, D., de Winter J. C. F.
- Completion rates and non-response error in online surveys: Comparing sweepstakes and pre-paid cash incentives...; 2014; LaRose, R., Tsai, H. S.
- Beauty is more than screen deep: Improving the web survey respondent experience through socially-present...; 2014; Casey, T. W., Poropat, A.
- Virtual research assistants: Replacing human interviewers by automated avatars in virtual worlds; 2013; Hasler, B. S., Tuchman, P., Friedman, D.
- Compared to a small, supervised lab experiment, a large, unsupervised web-based experiment on a previously...; 2013; Ryan, R. S., Wilde, M., Crist, S.
- Comparison of web-based versus paper-and-pencil administration of a humor survey; 2013; Wang, C.-C., Cheng, C.-L., Cheng, Y.-Y., Liu, K.-S.
- Does survey format influence self-disclosure on sensitive question items?; 2012; Kays, K., Gathercoal, K., Buhrow, W.
- Measurement invariance in training evaluation: Old question, new context; 2011; P., Gissel, A., Stoughton, J. W., Whelan, T. J.Clark, A. P.
- Color red in web-based knowledge testing; 2010; Gnambs, T., Batinic, B., Appel, Ma.
- Internet administration of self-report measures commonly used in research on social anxiety disorder...; 2010; Hedman, E., Ljótsson, B., Rück, C., Furmark, T., Carlbring, P., Lindefors, N., Andersson, G.
- Comparison of paper-and-pencil versus Web administration of the Youth Risk Behavior Survey (YRBS): Participation...; 2010; Denniston, M. M., Brener, N. D., Kann, L., Eaton, D. K., McManus, T., Kyle, T. M., Roberts, A. M., Flint...
- Factors affecting response rates of the web survey: A systematic review; 2010; Fan, W., Yan, Z.
- Psychometric properties of internet administered versions of Penn State Worry Questionnaire (PSWQ) and...; 2009; Zlomke, K. R.
- Web-based measurement: Effect of completing single or multiple items per webpage; 2009; Thorndike, F. P., Carlbring, P., Smyth, F. L., Magee, J. C., Gonder-Frederick, L., Ost, L. G., Ritterband...
- From paper to pixels: A comparison of paper and computer formats in psychological assessment ; 2008; Naus, M. J., Philipp, L. M., Samsi, M.
- Personalized salutation, power of sender and response rates to Web-based surveys; 2007; Joinson, A. N., Reips, U. -D.
- Computer-assisted questionnaires may facilitate collection of quality-of-life (QOL) data: At a cost; 2006; Smith, Ad. B., Velikova, G., Wright, E. P., Lynch, P., Selby, P. J.
- Exploring users' attitudes and intentions toward the web as a survey tool; 2005; Huang, H.-M., Liaw, S. S.
- Do print and Web surveys provide the same results?; 2004; Huang, H.-M.
- Humanizing self-administered surveys: experiments on social presence in web and IVR surveys; 2003; Tourangeau, R., Couper, M. P., Steiger, D. M., de Rouvray, C.
- Using pencil and paper, Internet and touch-tone phones for self-administered surveys: does methodology...; 2003; Knapp, H., Kirk, S. A.
- Using touch screen audio-CASI to obtain data on sensitive topics; 2001; Cooley, P. C., Rogers, S. M., Al-Tayyib, A. A., Ganapathi, L. F., Willis, G. B., Turner, C. F.